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DETAILED ACTION 

1. This action is responsive to the application filed on August 13th, 2001. Claims 1- 
30 are pending. Claims 1-30 are directed to an apparatus, a method and data structure 
for a "Displaying Image Data." 

Priority 

2. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(aHd), which 
papers have been placed in the file of record. 

Specification Objections 

3. The Specification is objected to because of the following informalities: each 
claim must be the object of a sentence starting with "I (or we) claim," "The invention 
claimed is" or the equivalent. Appropriate correction is required. See MPEP 
§608.01 (m). 

4. The Abstract of the disclosure is objected to because of "(Figure 8)" appearing at 
the end of the paragraph. Correction is required. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, If the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 
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5. Claims 1-2, 4-9, 11-12, 14-19, 21-22, 24-29 are rejected under 35 U.S.C. §1 03(a) 
as being unpatentable over Sen et aL (US 6,691.312) in view of Aharoni et al. (US 
6,014,694). 

Sen substantially teaches the invention as claimed including a method of 
multicasting video to multiple client nodes via intermediate nodes that includes 
accessing video information descriptive of the video to be multicast, accessing rate 
constraints of nodes in the distribution tree. (See abstract). 

As for claim 1 , Sen substantially teaches the method of claim 1 including viewing 
image data comprising: (See Fig. 1) 

(a) display means; (See Fig. 1 (102)) 

(b) network connecting means for transferring frames of said image data over a 
network from a remotely connected frame source, wherein: (Fig. 1 (108a, 108b, 108c)) 

(i) said image data comprises a plurality of image frames and has a frame rate 
from which may be inferred a due time for display of each frame in a sequence of 
frames in said image data; (See Fig. 4, Fig. 5, Fig. 6) 

Sen does not exjDressly disclose a frame source which returns a frame in 
response to a frame request issued over said network nor does it suggest processing 
means configured to play a clip. However, Aharoni teaches that the function of the video 
server is to accept a remote client connection request, retrieve a local or remote stored 
file and transmit it to the client. (See col. 1 1 , lines 29-31 ). Aharoni further discloses: 
(i) displaying selected frames from said frame source, on said display 

means, at their due time; and (See col. 8, lines 24-41 ). 
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(ii) skipping frannes in said franne sequence in response to an indication of 
the data transfer rate of said network. (See col. 12, lines 47-51). 
Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 

Claims 2 and 22 : 

Sen teaches the apparatus of claim 1 wherein a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

Sen fails to disclose an indication of the data transfer rate provided by a comparison of 
the relative position of an input and an output pointer in a queue of frames that have 
been selected for display. However, Aharoni expressly teaches comparing the sending 
rate to the receiving rate at col. 4, lines 31-34. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 
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Claims 4, 14 and 24 : 

Sen teaches the apparatus of claim 1 wherein a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

Sen fails to disclose frames that are skipped in response to a prediction of a network 
data transfer rate. 

However, Aharon! expressly teaches skipping frames in response to measured 
bandwidth of the channel at col. 12, lines 47-51 and col. 4, lines 46-55. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with skipping frames in response to measured bandwidth of the channel as 
disclosed by Aharoni. This system is preferable in that it provides for coping with 
variable bandwidth challenges of transporting video over any network generally. 
Claims 5,15 and 25 : 

Sen teaches the apparatus of claim 1 wherein a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

Sen fails to disclose frames that are prefetched into a frame queue prior to their 
due time. 
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However, Aharoni expressly discloses prefetching frames into frame queue at 
col. 2, line 66- col. 3, lineS and col. 12, lines 42-47. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with prefetching frames into frame queue as disclosed by Aharoni. This system is 
preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. Therefore, claim 5 is rejected. 
Claims 6, 16 and 26 : 

Sen teaches the apparatus of claim 1 wherein a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

Sen fails to disclose a frame skip rate which is defined by a user. 

However, Aharoni expressly discloses accessing rate constraints of nodes in the 
distribution tree at col. 1, line 65 - col. 3, line 12. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with accessing rate constraints of nodes as disclosed by Aharoni. This system is 
preferable in that it provides for custom frame skip rate. 
Claims 7, 17 and 27 : 

Sen teaches the apparatus of claim 1 wherein a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
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descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

Sen fails to disclose a frame selection for display by processing its due time with 
elapsed real time since playback started. 

However, Aharoni expressly discloses packet selection for display at col. 16, 
lines 24 - 29 and col. 8, lines 25-41 . 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with packet selection for display as disclosed by Aharoni. This system is preferable 
in that the sender constantly tries to utilize the available bandwidth as efficiently as 
possible by keeping the network pipe full. 

Claims 8 and 18 : 

Sen teaches apparatus for displaying image data, comprising: (See Fig. 1) 

(a) image data comprising a plurality of image frames, sequences of said frames 
being organised into clips, each clip having a frame rate, and each frame in a clip 
thereby having a due time for display with respect to a start time for playing the clip; 

(b) display means; (See Fig. 1 (102)) 

(c) memory means; (See Fig. 1) 

(d) network connecting means for enabling transfer of image data over a network 
from a frame source remotely connected to said network; and (See Fig. 1 (108a, 108b, 
108c)). 
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(e) processing means configured to perform operations to play a clip from said 
frame source by: (See Fig. 1) 

(1) selecting a next frame for preloading by skipping at least one frame in the 
clip's frame sequence; (ii) preloading a frame from said frame source into a frame 
queue in said memory means; (iii) displaying a preloaded frame at its due time; (iv) 
processing elapsed real time since the clip started playing with a frame timing 
parameter; and (v) updating the number of frames to skip in response to said 
processing of elapsed real time. 

Sen does not expressly disclose a frame source which returns a frame in 
response to a frame request issued over said network nor does it suggest processing 
means configured to play a clip. However, Aharoni teaches that the function of the video 
sen/er is to accept a remote client connection request, retrieve a local or remote stored 
file and transmit it to the client. (See col. 1 1 , lines 29-31 ). Aharoni further discloses: 

(i) displaying selected frames from said frame source, on said display 
means, at their due time; and (See col. 8, lines 24-41 ). 

(ii) skipping frames in said frame sequence in response to an indication of 
the data transfer rate of said network. (See col. 12, lines 47-51 ). 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 
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Claims 9, 19 and 29 : 

Sen teaches apparatus according to claim 8, wherein said frame timing 
parameter is the due time for a frame. 

Sen does not expressly disclose a frame timing parameter. However, Aharoni 
teaches displaying selected frames from said frame source, on said display means, at 
their due time; and (See col. 8, lines 24-41). 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 
Claims 11 and 21 : 

Sen teaches a method of displaying image data on an image viewing station, 
wherein: (a) the image viewing station comprises display means, processing means, 
and network connecting means for transferring frames of said image data over a 
network from a remotely connected frame source; (b) said image data comprises a 
plurality of image frames, and has a frame rate from which may be inferred a due time 
for display of each frame in a sequence of frames in said image data; (c) said frame 
source returns a frame in response to a frame request issued over said network; and (d) 
said processing means is configured to play a clip in which said method comprises: (i) 
displaying selected frames from said frame source, on said display means, at their due 
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time; and (ii) skipping frames in said frame sequence in response to an indication of the 
data transfer rate of said network. 

Sen does not expressly disclose a frame source which returns a frame in 
response to a frame request issued over said network nor does it suggest processing 
means configured to play a clip. However, Aharoni teaches that the function of the video 
server is to accept a remote client connection request, retrieve a local or remote stored 
file and transmit it to the client. (See col. 1 1 , lines 29-31 ). Aharoni further discloses: 

(i) displaying selected frames from said frame source, on said display means, at 
their due time; and (See col. 8, lines 24-41). 

(ii) skipping frames in said frame sequence in response to an indication of the 
data transfer rate of said network. (See col. 12, lines 47-51). 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 
Claim 12 : 

Sen teaches a method according to claim 1 1 , wherein said indication of the data 
transfer rate is provided by a comparison of the relative position of an input and an 
output pointer in a queue of frames that have been selected for display. 
Sen fails to disclose an indication of the data transfer rate provided by a comparison of 
the relative position of an input and an output pointer in a queue of frames that have 
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been selected for display. However, Aharoni expressly teaches comparing the sending 
rate to the receiving rate at col. 4, lines 31-34. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with comparing the sending rate to the receiving rate as disclosed by Aharoni. This 
system is preferable in that it provides for coping with variable bandwidth challenges of 
transporting video over any network generally. 

6. Claims 3. 13 and 23 are reiected under 35 U.S.C. §1 03(a) as being unpatentable 
over Sen et al. (US 6,691,312) in view of Hazra (US 6,510.553.) 

Sen substantially teaches the invention as claimed including a method of 
multicasting video to multiple client nodes via intermediate nodes that includes 
accessing video information descriptive of the video to be multicast, accessing rate 
constraints of nodes in the distribution tree. (See abstract). 

As for claim 3, Sen fails to disclose means for storing pre-rendered image 
frames. 

However. Hazra expressly discloses means for storing rendered image at col. 11, 
lines 1 - 9 and 20-24. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with means for storing rendered image as disclosed by Hazra. This system is 
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preferable in that the quality of the streaming video is not a function of the available 
bandwidth. 

7. Claims 10, 20 and 30 are rejected under 35 U.S.C. §1 03(a) as being 
unpatentable over Sen et al. (US 6.691,312) in view of Tremblav et al. (US 6,343.348.) 

Sen teaches the invention as claimed including a method of multicasting video to 
multiple client nodes via intermediate nodes that includes accessing video information 
descriptive of the video to be multicast, accessing rate constraints of nodes in the 
distribution tree. (See abstract). 

As for claims 10, 20 and 30, Sen fails to disclose processing instructions 
executed as multiple threads. 

However, Tremblay expressly discloses processing instructions executed as 
multiple threads at col. 5, lines 38 - 44. 

Hence, it would have been obvious at the time of the invention for an artisan of 
ordinary skill in the art to combine the apparatus for viewing image data disclosed by 
Sen with processing means executed as multiple threads as disclosed by Tremblay. 
This system is preferable in that the quality of the streaming video is not a function of 
the available bandwidth. 

Conclusion 

8. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Emmanuel Coffy whose telephone number is (571 ) 
272-3997. The examiner can normally be reached on 8:30 - 5:00 P.M. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ario Etienne can be reached on (571 ) 272-4001 . The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Emmanuel Coffy, Esq. 
Patent Examiner 
Art Unit 21 57 

***EC 

Dec 15, 2004 




''^TEOiNOLOGY CENTER 21( 



